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ABSTRACT 

In a recent paper, Altenbernd, Thomas and Wohrle have considered acceptance of 
languages of infinite two-dimensional words (infinite pictures) by finite tiling systems, 
with the usual acceptance conditions, such as the Buchi and Muller ones, firstly used for 
infinite words. The authors asked for comparing the tiling system acceptance with an 
acceptance of pictures row by row using an automaton model over ordinal words of length 
uj 2 . We give in this paper a solution to this problem, showing that all languages of infinite 
pictures which are accepted row by row by Buchi or Choueka automata reading words of 
length lJ 1 are Buchi recognized by a finite tiling system, but the converse is not true. We 
give also the answer to two other questions which were raised by Altenbernd, Thomas 
and Wohrle, showing that it is undecidable whether a Buchi recognizable language of 
infinite pictures is E-recognizable (respectively, A-recognizablc). 

Keywords: Languages of infinite pictures; tiling systems; automata reading ordinal 
words of length u) 2 ; topological complexity; Borel and analytic sets; E-recognizable; 
A-recognizable; decision problems. 

1. Introduction 

In a recent paper [1], Altenbernd, Thomas and Wohrle have considered accep- 
tance of languages of infinite two-dimensional words (infinite pictures) by finite 
tiling systems, with the usual acceptance conditions, such as the Buchi and Muller 
ones, firstly used for acceptance of infinite words. This way they extended the clas- 
sical theory of recognizable languages of finite pictures, [13], to the case of infinite 
pictures. 

On the other hand automata reading ordinal words have been first considered by 
Biichi in order to study the decidability of the monadic second order theory on 
countable ordinals. In particular he defined automata reading words of length us 2 , 
[5, 6]. Another model of automaton reading words of length uj 2 has been studied by 
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Choueka in [7] and it has been shown by Bedon that these two models are equivalent 
[2, 3]. They accept the so called regular w 2 -languages which can also be defined by 
generalized regular expressions, see also the work of Wojciechowski [26, 27]. 
In [1] the authors asked for comparing the tiling system acceptance with an ac- 
ceptance of pictures row by row using an automaton model over ordinal words of 
length uo 2 . 

We give in this paper a solution to this problem, showing that the class of languages 
of infinite pictures which are accepted by Biichi automata reading words of length 
ijj 2 is strictly included in the class of languages of infinite pictures which are Biichi- 
recognized by some finite tiling system. 

Another way to compare these two classes is to compare the topological complexity 
of languages in each of them, with regard to the Borel and projective hierarchies. 
We then determine the topological complexity of Buchi-recognizcd languages of in- 
finite pictures. This way we show that Biichi tiling systems have a much greater 
accepting power than automata over ordinal words of length oj 2 . 
Using topological arguments, we give also the answer to two questions raised in [1], 
showing that it is undccidable whether a Biichi recognizable language of infinite 
pictures is E-recognizable (respectively, A-recognizable). For that purpose we use a 
very similar technique as in a recent paper where we have proved several undecid- 
ability results for infinitary rational relations [12]. 

The paper is organized as follows. In section 2 we recall basic definitions for pictures 
and tiling systems. Biichi automata reading words of length w or to 2 are introduced 
in section 3. We compare the two modes of acceptance in section 4. Undccidability 
results are proved in section 5. 

2. Tiling Systems 

Let E be a finite alphabet and # be a letter not in E and let E = EU{#}. 
If m and n are two integers > or if m = n = 0, a picture of size (m, n) over E 
is a function p from {0, 1, . . . , m + 1} x {0, 1, . . . , n + 1} into E such that p(0, i) = 
p(m + 1, i) = # for all integers i £ {0, 1, . . . , n+ 1} and p(i, 0) = p(i, n + 1) = # for 
all integers i £ {0, 1, . . . , m+ 1} and p(i,j) £ E if i {0, m + 1} and j £ {0, n + 1}. 
The empty picture is the only picture of size (0, 0) and is denoted by A. Pictures of 
size (n, 0) or (0,n), for n > 0, are not defined. E*'* is the set of pictures over E. A 
picture language L is a subset of E*'*. 

An cj-picture over E is a function p from u> x u> into E such that p(i, 0) = p(0, i) = # 
for alii > and p(i,j) £ E for i, j > 0. is the set of w-pictures over E. An 

w-picture language L is a subset of E w ' w . 

2 

For E a finite alphabet we call E w the set of functions from u> x lu into E. So the 

2 

set E"' w of w-pictures over E is a strict subset of E" . 

We shall say that, for each integer j > 1, the j th row of an w-picture p £ is the 
infinite word p(l, j).p(2, j).p(3, j) . . . over E and the j th column of p is the infinite 
word p(j, l).p(j, 2).p(j, 3) . . . over E. 
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As usual, one can imagine that, for integers j > k > 1, the j th column of p is on 
the right of the k th column of p and that the j th row of p is "above" the k th row of 
p. This representation will be used in the sequel. 

We introduce now tiling systems as in the paper [1]. 

A tiling system is a tuple A=(Q, E, A), where Q is a finite set of states, £ is a finite 
alphabet, A C (S x Q) 4 is a finite set of tiles. 

A Biichi tiling system is a pair (A,F) where A=(Q,T,, A) is a tiling system and 
F C Q is the set of accepting states. 

A Muller tiling system is a pair (A, T) where A=(Q, S, A) is a tiling system and 
JFC 2^ is the set of accepting sets of states. 

Tiles are denoted by ( j" 3 ' 93 J j" 4 ' 94 J | with a t e E and 9l € Q, 

and in general, over an alphabet T, by ^ ^ 3 ^ 4 ^ with 6, E I\ 
We will indicate a combination of tiles by: 

/ 63 ^4 \ o f & 3 &4 \ _ ( M) M) \ 

\h b 2 )°{b[ b> 2 ) - { (hX) M) J 

A run of a tiling system A=(Q, S, A) over a (finite) picture p of size (m, n) over £ 
is a mapping p from {0, 1, . . . , m + 1} x {0, 1, . . . , n + 1} into Q such that for all 
(i, j) E {0, 1, . . . , m} x {0, 1, . . . , n} with j) = a 4J and p(i, j) = q itj we have 

/ a ij+ i a l+1 . j+1 \ Q f Qi,j+i Qi+i,j+i \ £ ^ 

A run of a tiling system A=(Q, S, A) over an w-picture p E E u,u is a mapping p 
from wxw into Q such that for all (i, j) E u x u with j ) = ajj and j) = (ftj 
we have 

/ aij+i a l+1 . j+1 \ I q itj+1 Qi+ij+i \ . ^ 

\ a i+l,j J \ Qi+l,j J 

We now recall acceptance of finite or infinite pictures by tiling systems: 
Definition 2.1 Let A=(Q, £,A) &e a tiling system, F C Q and 2®. 

• The picture language recognized by A is the set of pictures p E such that 
there is some run p of A on p. 

• The to -picture language A-recognized (respectively, E-recognized, Biichi-recognized) 
by (A,F) is the set of u) -pictures p E such that there is some run p of A 

on p and p(v) E F for all (respectively, for at least one, for infinitely many) 
v E lo 2 . 

• The LV-picture language Muller-recognized by (A,J-) is the set of uj -pictures 
p g such that there is some run p of A on p and Inf(p) E T where 
Inf(p) is the set of states occurring infinitely often in p. 
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As stated in [1], an w-picture language L C E w,w is recognized by a Biichi tiling 
system if and only if it is recognized by a Muller tiling system. 
We shall denote TSiT,"^) the class of languages L C which are recognized by 
some Biichi (or Muller) tiling system. 

3. Biichi Automata 

We shall assume the reader to be familiar with the elementary theory of count- 
able ordinals, which may be found in [20] . In fact we shall only need in this section 
to consider ordinals smaller than J 2 + 1. 

Let E be a finite alphabet, and a be a countable ordinal. An a-word x (word of 
length a) over the alphabet E is an a-sequence (sequence of length a) of letters in 
E. It will be denoted by (x(i))o<i< a — x(0).x(l).x(2) . . . x(i) . . . , where for all i, 
< i < a, x(i) is a letter in E. 

For an ordinal a > ui, the set of a- words over E will be denoted by E a . An 
a-language over S is a subset of E a . 

We assume now that the reader has some familiarity with the notion of Biichi and 
Muller automata reading infinite words, [24, 23, 19]. 

Definition 3.1 A Biichi automaton is a 5-tuple A= (E, Q,qo, A, F) where Q is a 
finite set of states, qo G Q is the initial state, ACQxExQis the transition 
relation, and F C Q is the set of final states. 

A run of A on the uj-word a G E" is an co-sequence x G Q u such that x(0) = <7o 
and (x(i), a(i), x(i + 1)) G A for i > 0. 

The run is called successful if Inf(x) fl F ^ %, where Inf(x) is the set of elements 
of Q which appear infinitely often in the oj-sequence x. 

An uj-word a G S w is accepted by A if there exists a successful run of A on a . 
L UJ (A)={cr G | A accepts a} is the ^-language recognized by A. 
A Muller automaton is defined in a similar way except that F is replaced by a set 
T C 2*2 of accepting sets of states and that a run x G Q u on an w-word a G E w is 
said to be successful iff Inf(x) G T . 

Biichi and Muller automata accept the same class of w-languages: the class of 
regular w-languages which is the w-Kleene closure of the class of regular finitary 
languages. It follows from Mac Naughton's Theorem that each regular w-languagc 
is also accepted by a deterministic Muller automaton, [24, 23, 19]. 

In order to define an automaton reading ordinal words of length > oj, we must add 
to the automaton a transition relation for limit steps: after the reading of a word 
which length is a limit ordinal, the state of the automaton will depend on the set 
of states which cofinally appeared during the run of the automaton, [6, 14, 2]. We 
shall give the following definition in the general case of automata reading ordinal 
words but in fact we shall only need in the sequel the notion of automata reading 
words of length u or u 2 . 

Definition 3.2 An ordinal Biichi automaton is a sextuple «4=(E, Q, qo, A, 7, F) 

where: E is a finite alphabet, Q is a finite set of states, qo G Q is the initial state, 
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A C Q x £ x Q is the transition relation, and 7 C P (Q) x Q is the transition 
relation for limit steps. 

T,,Q,q ,A and F keep the same meaning as before, the meaning of 7 is given by 
the following definition: 

Definition 3.3 A run of the ordinal Biichi automaton A=(T,, Q, q , A, 7, F), read- 
ing the word a G S Q , is an (a + 1 )-sequence of states x defined by: x(0) = go an d 
for i < a, (x(i), a(i), x(i + 1)) G A and for a limit ordinal i: (Inf(x,i),x(i)) G 7, 
where 

Inf(x, i) = {q G Q | V^i < i, 3v < i such that [i < v and x{v) = q} 

is the set of states which cofinally appear during the reading of the i first letters of 
a. 

A run x of the automaton A over the word a is called successful if x(a) G F . A 
word a G S Q is accepted by A if there exists a successful run of A over a . We 
denote L a {A) the set of words of length a which are accepted by A. 
In particular the above definition provides a notion of automata reading words of 
length uj 2 . Later Choueka defined another class of automata reading words of length 
LO 2 (and even io n for an integer n > 2) now called Choueka automata [7]. Bedon 
proved that these two classes of automata accept the same class of w 2 -languages, the 
class of regular o> 2 -languages which can be also defined by aj 2 -regular expressions 
[2, 3]. 

Remark 3.4 When we consider only finite words, the language accepted by an 
ordinal Biichi automaton is a rational language. And an oj-language is accepted by 
an ordinal Biichi automaton if and only if it is accepted by a Muller automaton 
hence also by a Biichi automaton. 

We shall use in the sequel another way of generating regular aj 2 -languages which is 
given by the following proposition. We shall reprove this result although it already 
appeared in [14] and has been also proved in [10]. 

Proposition 3.5 An uj 2 -language L C S" 2 is regular iff it is obtained from a 
regular uj-language R G T w by substituting in every ui-word a G R a regular 
w-language L a G to each letter a G T. 

Proof. Let A=(E, Q, qo, A, 7, F) be an ordinal Biichi automaton, and let 
L^2 (A) be the u> 2 -language recognized by A. 

Consider the reading of a word a G S w by A: After the reading of the first w 
letters, A is in state x(lj), after the reading of w.2 letters, A is in state x(lo.2) and 
so on. 

For qi E Q,qj G Q and E G Q, we denote by L(qi, qj,E) the w-language of words 
u G S w such that there exists a reading of u by A, beginning in state qi, ending in 
state qj after the reading of u, and going through the set of states E (including % 
and qj). 

We easily see that these w-languages are recognized by Muller automata therefore 
also by Biichi automata. 
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Consider now the new alphabet: 

r = Q x Q x P(Q) = {{qi,qj,E) \ Qi G Q, q 3 EQ,ECQ} 

and let R C r w containing an w-word er G if and only if c satisfies the two 
following properties: 

(1) . The first letter of a is in the form (q , q, E) and each letter (qi, qj, E) is followed 
by a letter (qj,q, G) with q £ Q,G C. Q. 

(2) . The set 

X = {q G Q | some letter (qi, qj, G) appears infinitely often in a and q G G} 
satisfies (X, qf) G 7 for some qf G F. 

i? is a regular w-language and if we substitute in R the w-language L(qi, qj, E) to 
each letter (qi, qj,E), we obtain the u> 2 -language recognized by A, i.e. L U 2(A). 

We have then proved one implication of Proposition 3.5. In fact we shall only need 
in the sequel this implication. 

We just mention that the converse can be easily proved by using regular expressions 
defining regular w-languages and regular o> 2 -languages. □ 

We have now to define precisely the acceptance of infinite pictures row by row by 
an automaton model over ordinal words of length 10 2 . 

To an infinite picture p G E"'" we associate an w -word p G S u which is defined 
by p(tu.n + m) = p(m + 1, n + 1) for all integers n, m > 0. 

This can be extended to languages of infinite pictures: for L C we denote 

L = {p I p G L} so L is an u> 2 -language over X. 

We can now set the following definition: 

Definition 3.6 A language of infinite pictures L C is accepted row by row by 
an ordinal Bilchi automaton if and only if the u> 2 -language L is regular. 
We shall denote the class of languages L G S w ' w such that L is regular, 

i.e. is accepted by an ordinal Biichi automaton. 

Remark 3.7 We have defined the ui 2 -wordp without the letters # appearing in the 
infinite picture p. It is easy to see that this does not change the notion of acceptance 
of a language of infinite pictures row by row by an ordinal Biichi automaton. 

4. Comparison of The Two Modes of Acceptance 

We can now state our main result. 
Theorem 4.1 Every language of infinite pictures which is accepted row by row by 
an ordinal Biichi automaton is Biichi-recognized by some finite tiling system, but 
the converse is not true. 

We are going to split the proof of Theorem 4.1 into the two following lemmas. 
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Lemma 4.2 Every language of infinite pictures which is accepted row by row by an 
ordinal Biichi automaton is Biichi-recognized by some finite tiling system. 

Proof. Let L C be a language of infinite pictures which is accepted row 
by row by an ordinal Biichi automaton, i.e. such that the w 2 -language L is regular. 

By Proposition 3.5, the c<j 2 -language L is obtained from a regular w-language R C 
r w , where Y — {a\, a2, . . . , a n } is a finite alphabet, by substituting in every w-word 
(j G R a regular u>-language Ri C S w to each letter a, £ T. 

Let ^4= (r, Q, go, A, F) be a Biichi automaton accepting the regular u-language R 
and, for each integer i G [l;n], let .4*= (S, Q l , gj, A 4 , F 4 ) be a Biichi automaton 
accepting the regular w-language Ri. We assume, without loss of generality, that 
for all integers i,j G [1; n], Q l n Q- 7 = and Q l n Q = 0. 

We shall describe the behaviour of a tiling system T=(K, S, A r ) which will accept 
infinite pictures pGL with a Muller acceptance condition. 

A run p of T on an u-picturc p E L will guess, for each integer j ' > 1, an integer 
ij G {1,2, ... ,n} such that the j th row pj of p is in R ij . It will then check that for 
all j > 1 the w-word is in i?^ and that the w-word .a^ . . . ... is in R. 

We are going now to describe informally a run p of T over an infinite picture 
p G E w ' w . 

Each state of T, i.e. each element of if, will consist of five components. 

The first component of a state of T is an integer ij G {1,2, ... ,n}. 

It will be used to guess that the w-word pj = p(l,j).p(2,j).p(3,j) . . ., forming the 

j th row of the picture p, is in the regular w-language Ri j . 

This first component will be constant on every row of the run p and will be propa- 
gated horizontally. 

The second component is an element of yj\<i< n Q l ■ 

If on the j th row the first component of the state is equal to ij then the second 
component on this row will be in Q tj . It is used to simulate (by horizontal propa- 
gation) a run otj of the Biichi automaton A lj on the w-word pj forming the j th row 
of p. 

So the projection of pj = p(l,j).p(2,j) ... on the second component of states will 
be equal to aj. 

In order to check that, for all integers j > 1, the w-word pj is in the regular lo- 
language Ri j , T has to check that each run ctj is successful, i.e. that Inf(aj)PiF lj ^ 
0, or equivalently that some state of F lj appears infinitely often in the second 
component (of the state) on the j th row. 
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This can be done in the following way. One can imagine an ant which moves on 
the picture p, but only horizontally from the left to the right or vertically. The 
movement of the ant will be indicated by the third component of the state which 
will be an element of {B, a, ad}. 

Letters a, ad will represent the trajectory of the ant and the blank symbol B will be 
used elsewhere. The letter ad will be only used when the ant goes down vertically 
on the picture. 

We shall need also the fourth component of the state of T which will be an element 
of 

The walk of the ant begins at the intersection of the first row and the first column 
of p, i.e. at the place of the letter p(l, 1) of p. 

At the beginning of this walk, the ant moves horizontally to the right on the first 
row (this way is marked by an a on the third component of the state) until it meets 
an element qi £ F 11 on the second component of the state. 

There is also a mark * on the first row which is propagated to the right following 
the movement of the ant. 

If the ant meets an element qi £ F n on the second component of the state, then 
the mark * is transferred on the second row just above it (on the same column) but 
with an indice 1, so it becomes *i. 

This mark *i will be next forwarded horizontally to the right but without the indice 
1. 

The ant then goes down vertically until it reaches the first row. In that special 
beginning of its walk, it is already on the first row! 

Next the ant moves again to the right on the first row, until it meets an element 
<?2 £ F 11 on the second component of the state. At that point it goes up on the 
second row (which is marked by * on the fourth component) and moves to the right 
on this row until it meets an element q$ £ F %2 on the second component of the 
state. 

At that point the mark * is transferred on the third row just above it (on the same 
column) but with an indice 1, so it becomes *i. This mark *i will be next forwarded 
horizontally to the right but without the indice 1. 

The mark * is now on the third row and it indicates that the ant will have to check 
successively the three first rows at next ascending moves. 

The ant then goes down vertically until it reaches the first row. These movements 
will be indicated by the letter ad on the third component of the state. Once on 
the first row its trajectory is again marked by the letter a. It moves to the right, 
looking for some state of F n on the first row, next goes up, moves to the right, 
looking for some state of F %2 on the second row, next goes up, moves to the right, 
again looking for some state of F t3 on the third row. 

This way it checks successively the first row, then the second row, and the third row 
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(marked with *), looking each time for an element of F tj on the j th row. When it 
meets an element q§ £ F 13 on the second component on the third row, it transfers 
the mark * (with an indice, so it becomes *i) just above it. This mark * will be 
next forwarded horizontally to the right, without the indice 1. 
The mark * is now on the fourth row and it indicates that the ant will have to check 
successively the four first rows at next ascending moves. 

The ant then goes down vertically until it reaches the first row and so on . . . 

We can see that if the mark *i appears infinitely often, it appears one time on each 
row, and this means that the ant has successively checked the first row, then the 
two first rows, then the three first rows, . . . , then the n first rows, . . . , looking each 
time for an element of F tj on the j th row. 

This implies that, for a given j th row, the ant has checked that some element of Q tj 
appears infinitely often on the second component of the state, hence the w-word 
Pj = p(l, j).p(2, j).p(3, j) ... is in the regular w-language i?,.. 

Conversely if for all integers j > 1 the w-word pj is in R ij , then there are some 
successful runs aj of the Biichi automata A %1 on the w-words pj such that the above 
defined movements of the ant make the mark *i to appear infinitely often. 
Notice that the blank symbol B appears on the fourth component of the state 
whenever neither ★ nor *i is used as explained above. 

T has now to check that the integers ij, j > 1, are such that the w-word .aj 2 . . . cij . . 
is in R. The fifth component of states of K is used for that purpose. On the first 
column this fifth component is an element of Q and is used to simulate, by vertical 
propagation, a run a of A on the w-word a il .a i2 . . . a ij . . . . 

This means that the projection of p(l, l).p(l, 2).p(l, 3) ... on this fifth component 
will be equal to a. 

On the other columns the fifth component will be simply the blank symbol B. 

We have seen that the set of states of the tiling system T will be: 

K = {l,2,...,n} x Ui< 4 <„Q* x {B,a,a d } x x ({B} U Q) 

and one can define a set of tiles A r such that corresponding runs of the tiling 
system T=(K 7 E, A r ) are described informally as above. 

A run p will be successful if and only if the mark *i appears infinitely often on the 
fourth component of p(v) and some state q G F appears infinitely often on the fifth 
component of p(v), for v G lo 2 . 

This acceptance condition may be written as a Mullcr condition. As stated in [1] 
any language of w-pictures which is Muller recognizable by a tiling system is also 
Biichi recognizable by a tiling system. □ 
Lemma 4.3 There exists a Biichi-recognizable language of infinite pictures which 
is not accepted row by row by any ordinal Biichi automaton. 
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Proof. The class of languages of infinite pictures which are Biichi-recognizable 
by tiling systems is not closed under complement, [1]. There exists a language T C 
vjw,w of infinite pictures, (where £ is a finite alphabet), which is Biichi-recognizable 
by a tiling system but such that its complement is not Biichi-recognizable by any 
tiling system. 

Then T cannot be a regular w 2 -language. Indeed otherwise its complement would 
be also a regular w 2 -language because the class of regular w 2 -languages is closed 
under complement, [2, 3]. The preceding proof would imply that the complement 
of T would be also Biichi-recognizable by a tiling system, towards a contradiction. 
□ 

Theorem 4.1 expresses that the class BA^^^) is strictly included in the class 
TS'(S W,W ). We shall see in the next section that one cannot decide whether a 
language L G TS , (£ W > W ) is in BA(S W ' W ). 

We are going now to compare the topological complexity of languages in the classes 
TS(E U ' U ) and BA{YP>"). 

From now on we shall assume that the reader is familiar with basic notions of 
topology and with the Borel and projective hierarchies on a space (where E is 
a finite alphabet having at least two letters), equipped with the Cantor topology, 
see for example [17, 23, 19, 15]. 

We recall that a subset of is a Borel set of rank a, for a countable ordinal a, iff 
it is in £° U n° but not in U 7<Q (£° U 11°). 

Recall also the notion of completeness with regard to reduction by continuous func- 
tions. For a countable ordinal a > 1, a set F C S w is said to be a £° (respectively, 
11°, ^-complete set iff for any set fiCT" (with T a finite alphabet): E G £° 
(respectively, E e 11°, E G H\) iff there exists a continuous function / : r w — > S w 
such that E = f~ 1 (F). 

For T a finite alphabet having at least two letters, the set T uy u of functions from 
ujxlo into T is usually equipped with the product topology of the discrete topology 
on T. This topology may be defined by the following distance d. Let x and y in 
r wxw such that x ^ y, then 

d(x, y) = — where 

n = min{p > | 3(i, j) x(i,j) ^ y(i,j) and i + j = p}. 

Then the topological space r wxw is homeomorphic to the topological space T u , 
equipped with the Cantor topology. Borel subsets of T UJXuJ are defined from open 
subsets as in the case of the topological space T". Analytic subsets of T UJXuJ are 
obtained as projections on r wx " of Borel subsets of the product space r wx " x P". 
The set E w,w of w-pictures over E, viewed as a topological subspace of E" xw , is 
easily seen to be homeomorphic to the topological space S wxw 7 via the mapping 
ip : £ w < w -> E wxw defined by <fi(p){i,j) =p(i + l,j + l) for allp G E^ w and i,j G u. 
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The topological complexity of languages of infinite pictures, accepted row by row 
by ordinal Biichi automata, is given by the following result which is stated in [9] . 
Proposition 4.4 ([9]) Let L C S W,IJ be a language of infinite pictures which is 
accepted row by row by an ordinal Biichi automaton. Then L is a Borel set of rank 
smaller than or equal to 5. 

This result can be easily proved, using Proposition 3.5 and the fact that every 
regular ^-language R C T u is a boolean combination of arithmetical DVsets, hence 
a A 3 -sct, so is definable in first order arithmetic by some first order E 3 -sentcncc 
and also by some first order Ii3-sentence. One can then show that every regular ui 2 - 
language is defined in first order arithmetic by some first order X 5 -scntcncc hence 
is a Borel set of rank smaller than or equal to 5. 

On the other side it has been proved in [1] that there exist some £;} -complete, hence 
non Borel, Biichi recognizable language of w-pictures. The two following lemmas 
will provide an alternative proof of this result and will be also useful to determine 
the Borel ranks of languages in TS(E U > U ). 

For an u-language L C we denote L B the language of infinite pictures p G £ w ' w 
such that the first row of p is in L and the other rows are labelled with the letter 
B which is assumed to belong to S. 

Lemma 4.5 J/L C E u is accepted by some Turing machine with a Biichi accep- 
tance condition, then L B is Biichi recognizable by a finite tiling system. 

Proof. Let L C S w be an w-language accepted by some Turing machine T 
with a Biichi acceptance condition. 

We assume that the Turing machine has a single semi-infinite tape, with one reading 
head which may also write on the tape. Q is the set of states of T, q is the initial 
state and F C Q is the set of accepting states. The input alphabet of T is S and 
its working alphabet is T D S. 

It has been proved by Cohen and Gold that one can consider only such restricted 
model of Turing machine [8] . 

An instantaneous configuration of T is given by an infinite word u.q.v where u G T* , 
q G Q, v G r w , and the first letter of v is the one scanned by the head of T. 
The initial configuration of T reading the infinite word a G S w is qo-a. 
A computation of T reading a G S w is an infinite sequence of configurations 
ao, ai, CK2) ■ ■■)£**)•■ ■ ) where olq = q^.a is the initial configuration and for all 
integers i > 0, on = Ui.qi.Vi is the (i + l) th configuration. 

The computation is successful if and only if there exists a final state qj G F and 
infinitely many integers i such that qi = qf. 

We can now use a similar reasoning as in the classical proof of the undecidability 
of the emptiness problem for recognizable languages of finite pictures, [13, p. 34]. 
We can define a set of tiles A in such a way that for a G a run p of the tiling 
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system T=(E, r U Q, A, F) over the infinite picture a B satifies: 

for each integer i > p(0,i).p(l,i).p(2,i) . . . = on = Ui.qi.Vi 

i.e. p(0,i).p(l,i).p(2,i) ... is the (i + \) th configuration of T reading the w-word 
cr e E". 

Thus the Biichi tiling system (T,F) recognizes the language L B . □ 

The following lemma is easy to prove. Details are left to the reader. 
Lemma 4.6 Let a be a countable ordinal > 2. If L C E" is S°- complete (re- 
spectively, II°- complete, T\- complete), then L B is X°- complete (respectively, Un- 
complete, H\- complete). 

In particular, for each alphabet S having at least two letters, we get some In- 
complete language of w-pictures in the form L B because it is well known that there 
exist some E^-complete u-languagcs LCE" accepted by some Biichi (or Mullcr) 
Turing machine. 

Notice that the E^-complete Biichi recognizable language T 2 C {0,1,$}"'" of all 
w-pictures encoding an w-tree with an infinite path given in [1] is also in that form. 

To determine the ranks of Borel languages of w-pictures we shall need to consider 
the first non-recursive ordinal which is called the Church Kleene ordinal and is 
usually denoted by bjf' K [18]. 

Proposition 4.7 Let E be a finite alphabet having at least two letters. 

(a) If L C is Biichi recognizable by a finite tiling system and is a Borel set 
of rank a, then a is smaller than Ldf' K . 

(b) For every non null countable ordinal a < <j0^ k , there exists some language of 
infinite pictures L C which is Biichi recognizable by a finite tiling system 
and is a Borel set of rank a. 

Proof. 

(a) . It was proved in [1] that every language L of infinite pictures which is Biichi 
recognizable by a finite tiling system is definable by an existential second order 
formula of arithmetic. It is well known that this implies that L is a S}-set (lightface) 
and that if moreover L is a Borel set then its Borel rank is smaller than uif K , see 

[18]- 

(b) . For a = 1 it is well known that a S^courokete set is simply an open but non 
closed set and that a II°-complete set is simply a closed but non open set. For 
example O = {p G | 3i > l,3j > 1 p{i,j) — B} is a S^-complete subset of 
E u ' u , and C = {p £ E"<" | Vi > l,Vj > 1 p(i,j) = B} is a n°-complete subset of 
£^". These two languages are in T5(S"^). 

On the other hand it is well known that, for every non null countable ordinal 
a < u>i K , there exists some S° -complete S a and some II°-complete P a , subsets 
of E w , which are effective, i.e. which are in the class of Ej (lightface) subsets of 
E" accepted by some Turing machine with a Biichi acceptance condition, [18, 23]. 
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Then by Lemma 4.6 the language (S a ) B C S w > w (respectively, (P a ) B C S w <") is 
£°-complete (respectively, II°-complete) and by Lemma 4.5 these languages are in 
TS(E U > U ). □ 

In conclusion of this section, these results show that Biichi tiling systems have a 
much greater accepting power than automata reading w 2 -words for acceptance of 
languages of infinite pictures. 

5. Decision Problems 

In a recent paper we have proved several undecidability results for infinitary 
rational relations [12]. These results were deduced from an extreme separation re- 
sult, proved using the undecidability of the universality problem for finitary rational 
relations and the existence of a -complete infinitary rational relation stated in 
another paper [11]. 

We shall use in this section a very similar technique, using this time the undecid- 
ability of the emptiness problem for languages of finite pictures and the existence 
of a S^-complete language of w-pictures. In a similar way we shall see that this 
implies several undecidability results. 

Proposition 5.1 Let T = {0, 1, then there exists a family T of Biichi-recognizable 
languages of w -pictures over T, such that, for L G T, either L = or L is a Hi- 
complete subset o/L w ' w ; but one cannot decide which case holds. 

Proof. We have seen that there exists a Biichi-recognizable language T C 
{0, 1} W ' W which is Uncomplete. 

On the other side the emptiness problem for recognizable languages of finite pictures 
is known to be undecidable: if S is an alphabet having at least one letter then it is 
undccidable whether a given recognizable language L C E*'* is empty, see [13]. 

Let us define, for a finite picture p G E*'* over a finite alphabet E and an infinite 
picture p' G over the alphabet Si = {0, 1}, the infinite picture p • p' over the 
alphabet L = E U Si U {#}. We assume that S = S U {#}, Si = Si U {#}, and 
f = ru where #i is a new letter different from the letter #. 

If p is a finite picture of size (m, n), the w-picture p • p' over L is defined by: 
p »p'(0, i) — pm p'(i, 0) = #i for all integers i > 0, 

p*p'{i,j) = p(i — l,j — 1) for all integers i £ {1, . . . , m + 2} and j e {1, . . . , n + 2}, 

p •p'(i,j) — # for all integers i G {1, . . . , m + 2} and j > n + 2, 

p •p'(i,j) — # for all integers i > m + 2 and j G {1, . . . , n + 2}, 

P*p'(hj) = p'(i — {m + 2), j — (n + 2)) for all integers i > m + 2 and j > n + 2. 

The intuitive idea is to construct an infinite picture p»p' having a prefix p "followed" 
by the infinite picture p', to "complete" elsewhere by some letters # and then to 
border with letters #i to get an w-picture in r w,w . 

For a language L C S*'* we set L • T — {p • p' \ p E L and p 1 G T}. It is easy 
to see that if L is a recognizable language of finite pictures then L • T is a Biichi- 
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recognizable language of w-pictures because T is also Biichi-recognizable. There are 
now two cases: 

(1) If L is empty then L • T is empty too. 

(2) If L is non-empty there is some finite picture p € L C E*'*. Let then ^ p be the 
mapping from E"'" into (E U Ei) w ' w defined by ip p (p') = p»p'. 

It is easy to see that the mapping ip p is continuous and that ^ p x (L • T) = T. But 
T is E;J;-complete and L»T, as well as every Biichi-recognizable language of infinite 
pictures, is a E];-set because it is definable by an existential second order monadic 
formula, [1]. This implies that L • T is a E];-complete set. 

We can now choose the family T to be the family of languages L»T obtained with 
E = {0} and L running over recognizable languages of pictures over E. □ 

In order to disprove the existence of decision procedures which test Biichi-recognizable 
w-picture languages for E-, respectively A-recognizability, we shall need the follow- 
ing lemmas. 

Lemma 5.2 Let E be an alphabet having at least two letters and L C be a 

E-recognized language of u> -pictures. Then L is a Yi%-subset o/S"' w . 

Proof. Let E be an alphabet having at least two letters and L C E w ' w be 
a language of w-pictures which is E-recognized by (A,F), where _4=((3,E, A) is a 
tiling system and F C.Q. 

Let R = {(p,p) G x Q^ 2 | p is a run of A on p}. It is easy to see that R 

is a closed subset of E w,w x where E"'" x Q w is equipped with the classical 
product topology. 

Let R E = {(p,p) E E^" x | 3v e u? p(v) e F}. It is easy to sec that R E is 
an open subset of E w,w x . 

Then the set Rn Re is a boolean combination of open sets. In particular it is a 
E^-subset of E w ' w x Q^ 2 , i.e. a countable union of closed subsets of E w ' w x . 
But the topological space E w ' w x Q u is compact because it is the product of two 
compact spaces. Thus every closed subset of E w,w x is also compact. Therefore 

2 

R (~1 R E is a countable union of compact subsets of E"' w x Q w . 

But the language L is E-recognized by (A,F) so it is the projection of the set 
RC\ R E onto E w,w . The projection from E w,w x onto E w>w is continuous and 
the continuous image of a compact set is a compact set. Thus the language L is a 
countable union of compact sets hence it is a countable union of closed sets, i.e. a 
Eg-subset of E w < w . □ 
Lemma 5.3 Let E be an alphabet having at least two letters and L C £ w > w he a 
A-recognized language of to -pictures. Then L is a closed subset o/E w ' w . 
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Proof. Let E be an alphabet having at least two letters and L C E U,IJ be 
a language of w-pictures which is A-recognized by (A,F), where A=(Q, S,A) is a 
tiling system and F CQ. 

We call cZ(£) the topological closure of L and we are going to prove that L = cl{L). 
For that purpose consider an w-picture p in cl(L). For all integers i > 1 there is 
some w-picture pi E L such that p | {o,i,...,»}x{o,i,. ..,»}= Pi |{o,i,...,»}x{o,i,...,i} 

For each integer i > 1, pi 6 L thus there is some run pi of A on such that for all 
v £ uj 2 pi(v) e F. 

Consider now the partial runs p\j — pi | { ,i j}x{o,i,...,j}) f° r J < i, of .4 on the 

restriction of Pi (hence also of p) to {0, 1, . . . ,j} x {0, 1, . . . 

We can now reason as in the proof of Theorem 4 (a) in [1] . These partial runs p[ j 
are arranged in a finitely branching tree, via the extension relation. By construction 
this tree is infinite so by Konig's Lemma there is an infinite path. This infinite path 
determines a run of A on p which is A-accepting thus p E L. 

We have then proved that cl(L) C L so L = cl(L) and L is a closed subset of E w '". 
□ 

We can now infer the following result. 

Proposition 5.4 There are no decision procedures which test Biichi-recognizable 
u -picture languages for E-, respectively A-recognizability. 

Proof. Consider the family T of w-picture Biichi-recognizable languages over 
T, such that, for L e T, either L = or L is a S^-complete subset of r w ' w . 

In the first case, L is obviously A-rccognizable and E-recognizablc. In the second 
case L is Sj;-complete so in particular it is not a Borel subset of r w,w . By Lemmas 
5.2 and 5.3 it cannot be E-recognizable (respectively, A-recognizable). But one 
cannot decide which case holds. □ 

As remarked in [1] Staiger- Wagner and co-Biichi recognizability reduces to E-recognizability 
so the above proof can be applied to Staiger- Wagner and co-Biichi recognizability 
instead of E-recognizability. 

Proposition 5.1 gives an extreme separation result which implies other undecidabil- 
ity results. For example for any Borel class S° or 11°, a being a countable ordinal 
> 1 , it is undccidable whether a given Biichi-recognizable language of w-pictures is 
in S° (respectively 11°). It is even undecidable whether a given Biichi-recognizable 
language of ^-pictures is a Borel set or a T\ -complete set. 

Remark that the same result holds if we replace Borel classes by arithmetical 
classes £, or 11;, i > 1, and the class of Borel sets by the class of arithmetical 
sets U„>iS„ = U„>iII„. 
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These results show a great contrast with the case of recognizable languages of infi- 
nite words where such problems are decidable [16]. 

Recall now the following definition, see [1]: a tiling system is called deterministic if 
on any picture it allows at most one tile covering the origin, the state assigned to 
position (i + l,j + 1) is uniquely determined by the states at positions (i + 

1> j)i (hj + 1) an d the states at the border positions (0,j + 1) and (i + 1,0) are 
determined by the state (0, j), respectively (i,0). 

As remarked in [1] , the hierarchy proofs of the classical Landwebcr hierarchy defined 
using deterministic w-automata "carry over without essential changes to pictures" . 
In particular it is easy to see that a language of w-pictures which is Buchi-recognizcd 
by a deterministic tiling system is a nS^-set. 

Remark that if we use the classical Muller acceptance condition instead of the Buchi 
condition, we can easily show, as in the case of infinite words, that a language of 
w-pictures which is Muller-recognized by a deterministic tiling system is a boolean 
combination of n^-sets. 

We now state the following results. 

Proposition 5.5 Let T = {0, 1,#} as in Proposition 5.1. It is undecidable for a 
given Biichi-recognizable language L C r"' u whether: 

(1) L is Biichi-recognized by a deterministic tiling system. 

(2) L is Muller-recognized by a deterministic tiling system. 

(3) its complement T U,UJ — L is Biichi-recognizable. 

(4) L is uj 2 -regular. 

Proof. Consider the family T of Biichi-recognizable w-picture languages given 
by Proposition 5.1. Then two cases may happen for L G T: either L is empty or L 
is S^-complctc. 

In the first case L is obviously recognized by a deterministic Buchi or Muller tiling 
system; its complement Y u ' u — L = r w,w is Biichi-recognizable and L is u> 2 -regular. 
In the second case L is H\ -complete. Thus L is not a Borel set hence it is neither 
Buchi nor Muller-recognized by any deterministic tiling system and L is not ir- 
regular. Moreover in this second case its complement r w,w — L is a n^-complete 
subset of r w,w . It is well known that a 11^ -complete set is not a S^-set thus it 
cannot be Biichi-recognizable. 

But Proposition 5.1 states that one cannot decide which case holds. □ 
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ANNEXE : 
ERRATUM TO THE PAPER : 



ON RECOGNIZABLE LANGUAGES 
OF INFINITE PICTURES 

Recall first that the following result was stated as Proposition 4.7 in [Fin04]. 

Proposition 4.7 Let T, be a finite alphabet having at least two letters. 

(a) If L C E u,u is Biichi recognizable by a finite tiling system and is a Borel set 
of rank a, then a is smaller than wf K . 

(b) For every non null countable ordinal a < wf K , there exists some language of 
infinite pictures L C which is Biichi recognizable by a finite tiling system 
and is a Borel set of rank a. 

Item (a) of this result was deduced from the fact that if L is a (lightface) £}-set 
and that if moreover L is a Borel set then its Borel rank is smaller than K . This 
fact, which is true if we replace the (lightface) class T,\ by the (lightface) class A}, 
is actually not true and the given reference [Mos80] does not contain this result. 

Kechris, Marker and Sami proved in [KMS89] that the supremum of the set of Borel 
ranks of (lightface) II}, so also of (lightface) sets is the ordinal 7^. 
This ordinal is precisely defined in [KMS89]. Kechris, Marker and Sami proved 
that the ordinal j), 1S strictly greater than the ordinal 8\ which is the first non A3, 
ordinal. Thus in particular it holds that wf K < 72. Notice that the exact value of 
the ordinal 72 may depend on axioms of set theory. For more details, the reader is 
referred to [KMS89] and to a textbook of set theory like [Jec02] . 

Notice that it seems still unknown whether every non null ordinal 7 < 72 is the 
Borel rank of a (lightface) Ii\ (or Sj) set. On the other hand, for every non null 
ordinal a < wf K , there exist some S° -complete and some Il^-complete sets in the 
class A} C £}. This is a well known fact of Effective Descriptive Set Theory which 
is proved in detail in [FL07]. 

We can now state the following result which corrects the above false Proposition 
4.7. 

Theorem 

(a) The Borel hierarchy of the class C of Biichi recognizable language of infinite 
pictures is equal to the Borel hierarchy of the class 

(b) 72 = Sup {a I 3L G C such that L is a Borel set of rank a}. 
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(c) For every non null ordinal a < wf K , there exists some TP a -complete and some 
Uncomplete uj -languages in the class C. 

This result follows easily from the proof of Lemmas 4.5 and 4.6 of [Fin04] and from 
the above cited result of Kechris, Marker and Sami proved in [KMS89]. 

Notice that a very similar result was obtained in [Fin06] for the class of w-languages 
accepted by (real time) one counter Biichi automata, and in [Fin08] for the class of 
infinitary rational relations accepted by 2-tape Biichi automata. 

References 

[Fin04] O. Finkel. On recognizable languages of infinite pictures. International Journal 
of Foundations of Computer Science, 15(6):823-840, 2004. 

[Fin06] O. Finkel. Borel ranks and Wadge degrees of omega context free languages. 
Mathematical Structures in Computer Science, 16(5):813-840, 2006. 

[Fin08] O. Finkel. Wadge degrees of infinitary rational relations. Special Issue on 
Intensional Programming and Semantics in honour of Bill Wadge on the occasion 
of his 60th cycle, Mathematics in Computer Science, 2(1):85-102, 2008. 

[FL07] O. Finkel and D. Lecomte. Classical and effective descriptive complexities of 
omega-powers. 2007. preprint, available from http://fr.arxiv.org/abs/0708.4176. 

[Jec02] T. Jech. Set theory, third edition. Springer, 2002. 

[KMS89] A. S. Kechris, D. Marker, and R. L. Sami. 11} Borel sets. Journal of Symbolic 
Logic, 54(3):915-920, 1989. 

[Mos80] Y. N. Moschovakis. Descriptive set theory. North-Holland Publishing Co., 
Amsterdam, 1980. 



20 



